Add finglerling potatoes to baking sheet and drizzle olive oil, lemon juice, thyme, and salt and pepper over the potatoes. Use your hands to massage the potatoes to make sure all of the potatoes are equally coated with seasoning. Next, place potatoes flesh side down on the pan before putting in oven.